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LONG-TERM  GOALS 

In  this  project  we  initiated  a  3  year  effort  by  the  Naval  Research  Laboratory  Code  7544  to  enable  Navy 
aerosol  forecasting  to  take  full  advantage  of  available  data  feeds  through  the  investigation  of 
fundamental  atmospheric  composition  observability.  The  next  generation  of  data  feeds  and  associated 
technology  presents  a  number  of  challenges  and  opportunities  which  require  attention.  These  include: 
1)  The  transition  from  NASA  EOS  sensors  to  the  next  generation  of  diversified  operational  and  near 
real  time  data  sources;  2)  The  move  to  a  constellation  approach  to  global  atmospheric  composition 
observing,  3)  The  expected  near  real  time  availability  of  US  and  European  lidar  data;  4)  The  enhanced 
availability  of  surface  and  aircraft  observations,  and  5)  Increased  aerosol  model  demands  for  such 
applications  as  joint  surface-atmosphere  retrievals,  directed  energy(DE),  and  intelligence,  surveillance, 
and  reconnaissance  (ISR).  This  increase  in  the  number  of  potential  data  sources,  coupled  with  further 
efficacy  demands,  creates  an  imperative  need  to  understand  the  nature  of  global  aerosol  observability 
and  the  development  of  realistic  uncertainties  for  composition  observations,  retrievals  and  model 
products.  Outstanding  problems  facing  the  community  relate  to  such  issues  as  observation  bias, 
representativeness,  and  information  spreading  for  the  myriad  of  sporadic  data  sources  available.  To 
meet  this  need,  we  propose  to  investigate  the  use  of  these  diverse  flows  of  data  using  ensemble  and 
ensemble  data  assimilation  technologies  to  be  incorporated  into  the  Navy  Aerosol  Analysis  and 
Prediction  System  (NAAPS)/Navy  Variational  Analysis  Data  Assimilation- Aerosol  Optical  Depth 
(NAVDAS-AOD)  framework. 

OBJECTIVES 

Our  overarching  goal  is  to  ultimately  investigate  applied  science  aerosol  observability  issues  related  to 
the  proper  determination  of  observed  product  efficacy  and  information  spreading.  To  this  end  the  core 
methodology  will  be  through  the  development  and  application  of  an  ensemble  version  of  NAAPS  and 
its  subsequent  ensemble  based  data  assimilation  system.  Subcomponents  include; 

1)  The  development  of  an  ensemble-based  NAAPS  system  which  makes  use  of  the  FNMOC 
NOGAPS  ensemble  data  set:  Here  we  will  use  the  base  NAAPS  model,  including  the  data 
assimilation  system  and  run  in  parallel  with  the  20  NOGAPS  fields,  further  perturbed  with  10 
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to  30  additional  perturbations  to  source  and  sink  functions.  This  version  of  NAAPS  will  be 
prepared  for  eventual  transition  to  6.4  and  FNMOC  if  the  Navy  so  desires. 

2)  The  development  of  key  verification  metrics  of  models  and  observations  alike:  Based  on  initial 
simulation  of  the  ensemble,  we  will  investigate  appropriate  error  metrics  for  Navy  satellite  and 
model  products  that  account  for  the  non-Gaussian,  spatially  correlated  nature  of  biases  present 
in  the  environment.  This  objective  includes  the  development  of  probabilistic  tools  for  forecasts. 
These  can  then  be  applied  to  satellite  observations  for  model  verification. 

3)  Investigation  into  the  nature  of  available  satellite  and  in  situ  observations  including  their  flow 
dependant  correlation  lengths  for  use  in  NAVDAS-AOD:  The  optimal  mix  of  meteorological 
and  source/sink  perturbations  for  the  NAAPS  ensemble  for  given  computational  constraints 
will  be  identified.  A  particular  emphasis  will  be  on  the  application  of  these  methods  to  aerosol 
vertical  distribution. 

4)  The  incorporation  of  NAAPS  in  to  the  NCAR  Data  Assimilation  Test-bed  (DART):  Once  the 
NAAPS  ensemble  model  is  running  quasi-operationally  and  is  well  understood,  we  will  port 
NAAPS  to  the  DART  package  at  NCAR.  This  is  the  first  step  in  developing  our  ensemble- 
based  data  assimilation  system. 

5)  The  creation  of  a  research  grade  ensemble-based  data  assimilation  system:  Based  on  our 
experience  with  the  DART  system,  we  anticipate  being  able  to  have  the  ability  to  harvest  and 
develop  a  robust  ensemble  based  data  assimilation  system.  This  will  be  used  to  supplement  the 
existing  3DVAR  aerosol  data  assimilation  system  currently  in  use.  Emphasis  in  this  system 
will  be  on  sparse  or  isolated  observations  such  as  provided  by  lidars,  sun  photometers  and 
surface  reports.  In  addition,  ensemble  covariability  studies  will  be  carried  out  to  address 
phenomenological  questions  such  as  modes  of  atmosphere/aerosol  coupling. 

6)  Collaborate  with  other  centers  to  derive  an  aerosol  consensus  for  severe  events:  It  has  been 
shown  that  for  many  extreme  events  consensus  forecasting  is  a  top  perfonner.  In  this  objective 
we  wish  to  investigate  the  applicability  of  performing  multi-model  consensus  of  GMAO, 
ECMWF  and  other  centers  to  investigate  the  predictability  and  extent  of  significant  aerosol 
events. 

APPROACH 

Work  perfonned  in  FY1 1  focused  on  the  development  of  NAAPS  single  model  and,  in  partnership 
with  other  operational  centers  globally,  the  creation  of  a  first  of  its  kind  multi-model  ensemble.  In 
preparation  for  years  2  and  3  we  also  began  to  examine  the  use  of  Ensemble  Kalman  Filter  (EnKF) 
methods  as  a  data  assimilation  engine  for  NAAPS. 

Our  first  task  for  this  project  was  to  develop  the  modeling  framework  to  run  and  display  an  ensemble 
version  of  NAAPS  (henceforth  eNAAPS)  quasi-operationally.  Nominally  we  use  the  20  NOGAPS 
ensemble  members  generated  by  FNMOC  every  12  hours.  On  top  of  these,  we  will  generate  another 
8-20  members  based  on  perturbations  to  the  NAAPS  source  function.  The  selection  process,  how 
these  draws  will  be  made,  is  critical.  On  one  hand,  we  could  simply  scale  all  source  functions  +/-  some 
percent;  this  would  maximize  correlation  lengths  and  ultimately  influence  plumes  at  the  continental 
scale.  On  the  other  hand,  perfonning  draws  on  the  6  hourly  model  time  step  will  shorten  correlation 
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lengths  to  individual  event  levels.  Establishing  the  proper  balance  of  draws  coupled  with  the 
computational  cost  of  each  model  simulation  will  require  a  great  deal  of  back-and-forth  between  model 
development  and  the  analysis  components  of  the  project.  This  balance  will  also  drive  computer  and 
storage  requirements  procured  under  this  grant. 

After  the  model  was  running  quasi-operationally,  adequate  tools  and  display  system  were  developed. 
Basic  tools  for  analyzing  ensemble  variably,  correlation  length  scales,  and  the  most  commonly 
employed  “spaghetti  plots”  were  largely  adapted  from  existing  Matlab  code  into  Perl,  Python  and  IDL 
framework  currently  used  in  7544  and  FNMOC.  Online  verification  products  based  on  AERONET, 
satellite  data  and  own  analysis  are  being  developed. 

In  a  similar  manner  to  eNAAPS,  we  cooperate  with  other  meteorological  centers  over  the  globe  which 
are  developing  global  aerosol  prediction  capabilities.  By  pulling  data  from  such  centers  as  ECMWF, 
JMA,  NASA  GMAO,  and  NOAA  NCEP,  we  created  a  first  of  its  kind  global  aerosol  multi-model 
ensemble.  For  comparison  purposes,  products  generated  are  similar  in  nature  to  eNAAPS. 

While  we  view  this  first  half  of  the  development  component  to  be  straightforward,  beneficial  to  Navy 
needs  and  of  very  low  risk,  the  bulk  of  the  effort  in  years  two  and  three  will  be  towards  the  much 
higher  risk/reward  ensemble  based  data  assimilation  effort.  The  Japan  Meteorological  Agency  (JMA) 
and  its  funded  researchers  have  made  significant  progress  in  the  application  of  Ensemble  Kalman  Filter 
(EnKF)  to  aerosol  modeling.  Due  to  the  extensive  lidar  network  maintained  by  the  Japanese  National 
Institute  for  Environmental  Studies  (NEIS),  coupled  now  with  space  based  CALIOP  lidar  data,  the 
Japanese  have  a  solid  observing  system  for  the  assimilation  of  major  dust  and  pollution  outbreaks  with 
a  particular  emphasis  on  boundary  layer  aerosol  particles.  This  capability  is  in  line  with  many  US 
Navy  needs  and  should  be  applied.  Our  course  of  action  is  to  port  NAAPS  into  the  NCAR  Data 
Assimilation  Research  Testbed  (DART).  DART  hosts  numerous  ensemble-based  data  assimilation 
tools  including  the  core  components  of  an  EnKF  system.  Both  NOGAPS  and  COAMPS  have  already 
been  ported  to  DART  and  in  fact  ensemble  based  COAMPS  dust  source  functions  studies  are  already 
underway  under  a  joint  project  with  Dr.  Hansen.  Hence,  in  house  knowledge  already  exists  to  expedite 
this  process.  Included  in  this  budget  is  additional  travel  money  so  that  NRL  developers  can  spend  the 
required  time  at  NCAR  to  make  this  port  happen. 

WORK  COMPLETED 

1)  An  ensemble  version  of  NAAPS  (eNAAPS)  was  created  running  off  of  the  20  member 
NOGAPS  ensemble. 

2)  A  multi-model  ensemble  of  Navy,  ECMWF,  JMA  and  NASA  GMAO  global  aerosol  fields  was 
created.  Names  the  International  Cooperative  for  Aerosol  Prediction  (ICAP)  ensemble, 
products  include  mean/spread  plots,  “spaghetti”  plots,  and  event  threat  scores. 

3)  A  website  has  been  created  for  the  distribution  of  both  eNAAPS  and  the  ICAP  ensemble. 

4)  Online  verification  tools  have  been  generated  for  scoring  of  ensemble  members. 

5)  Perfonned  preliminary  work  on  the  use  of  the  Data  Assimilation  Research  Testbed  (DART)  for 
ensemble  based  data  assimilation  in  NAAPS  has  begun. 
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RESULTS 


Research  results  for  this  project  can  be  divided  into  areas  of  ensemble  development,  verification,  and 
data  assimilation. 

Ensemble  Development:  7544  developed  collinearly  both  the  eNAAPS  single  model  and  ICAP  multi¬ 
model  ensemble,  both  of  which  became  quasi-operational  in  late  December  2010.  Data  for  eNAAPS  is 
available  to  the  general  public  via  the  7544  website  (http://www.nrlmry.navy.mil/aerosol/)  at 
(http://www.nrlmry.navy.mil/aerosol/NAAPS_ens.php  ).  An  example  of  these  products  is  presented  in 
Figure  1.  In  a  webpage  of  similar  style,  the  ICAP  multi-model  data  is  available  (Figure  2).  However, 
as  the  model  centers  are  tuning  their  models,  we  currently  do  not  advertise  this  site  outside  of  the 
ensemble  participants.  A  new  site  where  individual  models  are  not  identified  is  under  construction. 

Verification:  Key  to  the  ensemble  system  development  is  verification,  which  is  underway  at  the 
aforementioned  distribution  websites.  An  example  plot  against  AERONET  is  presented  in  Figure  3.  In 
cooperation  with  ONR  sponsored  elements  at  the  University  of  North  Dakota,  our  own  analysis 
verification  system  has  been  created  where  forecasts  are  compared  to  that  time  period’s  post  data 
assimilation  analysis.  This  allows  for  very  rapid  evaluation  of  forecast  model  health  in  a  contiguous 
manner. 

Data  Assimilation:  Output  from  eNAAPS  has  been  utilized  in  DART  tools  to  study  ensemble  output 
spread  and  error  covariance  for  specific  cases.  Focus  has  been  on  Asian  dust  and  pollution  events 
which  showed  a  high  degree  of  spread  in  the  forecast  magnitude  in  aerosol  optical  depth.  In  general, 
such  areas  appear  to  be  associated  with  diversity  in  frontal  location.  Frontal  location  in  turn  is 
associated  with  frontal  strength  and  ultimately  precipitation.  This  precipitation  uncertainty  propagates 
into  the  wet  deposition  algorithms  in  NAAPS,  ultimately  modulating  aerosol  loading  and  forecast  EO 
propagation  impacts.  These  cases  will  be  used  as  starting  points  for  investigations  for  EnKF 
assimilation  in  eNAAPS  in  FY12. 

IMPACT/APPLICATIONS 

We  expect  much  of  this  work  to  be  of  immediate  use  to  the  warfighter.  Just  as  the  current  NRF 
aerosol  page  is  frequently  used  in  the  METOC  community,  we  expect  these  ensemble  products  to  be  of 
immediate  applicability.  To  begin  with,  in  key  portions  of  the  globe  we  can  generate  dust,  smoke,  or 
pollution  “Spaghetti  plots”  for  each  of  the  meteorological  members  (Figure  4)  or  independent  models. 
These  can  also  be  shown  spatially  as  areas  of  high  variability  (Figure  lc).  In  these  areas  we  will 
collaborate  with  Dr.  Hansen  who  is  working  on  METOC  impacts,  decision  aids,  and  scorecards. 

TRANSITIONS 

We  have  begun  discussions  with  FNMOC  to  transition  eNAAPS  to  operations. 

RELATED  PROJECTS 

This  project  is  tightly  coupled  to  a  number  of  ONR  32  programs,  particularly  those  of  Professor 
Jianglong  Zhang  at  the  University  of  North  Dakota.  Our  primary  transition  partner  is  Douglas 
Westphal,  who  is  principal  investigator  on  the  Large-Scale  Aerosol  Model  Development  (PI:  Doug 
Westphal).  New  data-processing  and  visualization  systems  are  being  adapted  for  aerosol  research 
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through  the  COAMPS-On  Scene(COAMPS-OS  R  )'  IVPS  charts  program  (PI:  John  Cook).  We  have 
also  begun  working  with  Jim  Hansen  on  his  ONR  -funded  project  for  the  use  of  ensemble  data 
assimilation  in  the  prediction  of  atmospheric  constituents. 
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Wednesday  26  January  2011  OOUTC  NAAPS  Forecast  te072 

Saturday  29  January  2011  OOUTC  Valid  Time 

Oust  Meteorological  Ensemble  Mean  Aerosol  Optical  Depth  at  SSOnm 
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Wednesday  26  January  2011  OOUTC  NAAPS  Forecast  t»072 
Saturday  29  January  2011  OOUTC  VaUd  Time 

Dust  Meteorological  Ensemble  Mean  AOD  Warning  Area  (>50%  members  above  0.8) 


Main  Listing  /  NAAPS  Ensemble  Byzantium  Dust  Aerosol  Optical  Depth  Archive 


Wednesday  26  January  2011  OOUTC  NAAPS  Forecast  t+072 
Saturday  29  January  2011  OOUTC  Valid  Tune 

Dust  Meteorological  Ensemble  Mean  0  8  Aerosol  Optical  Depth  at  SSOnm 


Wednesday  26  January  2011  OOUTC  NAAPS  Forecast  te072 
Saturday  29  January  2011  OOUTC  Valid  Time 


Figure  1.  Example  output  for  the  quasi-operational  ensemble  NAAPS  (eNAAPS)  from  the  NRL 
aerosol  website.  Shown  in  the  72  hour  forecast  initiated  on  January  26st  for  the  Africa/Europe 
domain.  Given  are  (upper  left)  ensemble  mean,  (upper  right)  spaghetti  plot  for  aerosol  optical  depth 
>0.8,  (lower  left)  dust  warning  area  where  50%  or  more  members  predict  dust  optical  depths  >0.8, 
and  (lower  right)  mean  and  standard  deviation  of  the  ensemble  AODs. 
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Dust  AOD  [550nm] 


Wednesday  26  January  2011  OOUTC  NAAPS  Forecast  at  Sede  Boker,  Israel 
Meteorology  Ensemble  Dust  Aerosol  Optical  Depth  at  550nm 


-  NAAPS  Ens  // 

-  MACC 

-  NAAPS 

-  GEOS-5 


1.75 


1.50 


1.25 


1.00 


0.75 


0.50 


0.25 


0.00 


<>/  <*<?,  <*9.  30, 

•yv/>  ■'^/j 

Generated  Mondav  31  lanuarv  2011  OOUTC  NRL/Monterev  Aerosol  Modelina 


Figure  2.  Multimodel  ensemble  output  for  Navy  eNAAPS,  ECMWF  MAAC,  operational  NAAPS 
and  NASA  GMAO  GEOS-5  for  a  dust  event  in  northern  Africa  for  January  29th,  2011 

as  also  used  in  Figure  1. 


7 


NAAP5  Forecast  at  Sede  Boker,  Israel 

Meteorology  Ensemble  Total  Aerosol  Optical  Depth  at  550nm 


Figure  3.  Example  verification  plot  showing  NAAPS,  eNAAPS  forecast  data  against  AERONET  sun 

photometer  data  for  the  January  29th  2011  dust  event. 
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